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Abstract. We compute the Selberg trace formula for Hecke operators (also called the trace formula 
for modular correspondences) in the context of cocompact Kleinian groups with finite-dimentional 
unitary representations. We give some applications to the distribution of Hecke eigenvalues, and give 
an analogue of Huber's theorem. 



1. Introduction 

1.1. Motivation. The Selberg trace formula has been well studied for cofinite Kleinian and Fuch- 
sian groups. In the Fuchsian case: nSel561IRoe66IIVKF7^|Hej76||FIe]c5}IVen82llBus92||Iwa02|; in the 



Kleinian case: I EGM981 IFri05al lFri05bl . For the most part (excepting [Hej76, |Hej83| ) the references 
above consider the standard Selberg trace formula which entails two objects: a discrete group F, 
and possibly a finite-dimensional unitary representation \- A third object to consider is a Hecke 
operator. 

The Selberg trace formula (and the underlying Selberg spectral theory) for Hecke operators (also 
known as the Selberg trace formula for modular correspondences^ is far from a trivial extension 
of the standard Selberg trace formula. By considering the abundance of Hecke operators for the 
Modular group T = PSL(2,Z), Lindenstrauss and Venkatesh ( HLV07I . MG0IO6I Chap. 4]) gave a 
new prooflfor the existence of infinitely many even Maafi form^in L 2 (M \ T). 

Strombergsson (|Str01|) made extensive use of the trace formula for Hecke operators to solve a 
problem in the well known spectral correspondence for quaternion groups — the Jacquet-Langlands cor- 
respondence (|Hej85|). More specifically, Strombergsson completely determined the image of the 
Jacquet-Langlands correspondence^ In fact, in [Str98J, he extended the Selberg trace formula for 



modular correspondences from the cocompact Fuchsian case (|Hej76[) to the cofinite Fuchsian 



case. 



The possibility for a trace formula for Hecke operators started with Selberg [Sel89. pp. 444- 
446, 460-462, 504-505]. In ]Hej76) Hejhal gave an explicit trace formula for modular correspon- 
dences for cocompact Fuchsian groups with finite-dimensional unitary representations and integer 



^Some authors seem to refer to the subject as The Selberg trace formula for modular correspondences and some as The Selberg 
trace formula for Hecke operators. For our purposes these are interchangeable. To be perfectly precise, we are not computing 
the trace of a Hecke operator, but rather the trace of Mh(A), where M is a Hecke operator, A is the Laplacacian, and h is 
a holomorphic function with a certain decay rate. 

2 The old proof is Selberg's original method: The determinant of the scattering matrix is shown to have order that is 
sufficiently small. 

''Their proof works in much more generality. 

4 The bijective correspondence between the nontrivial automorphic forms on the multiplicative group of a division 
quaternion algebra and certain cusp forms on GL(2). 
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weight k > forms. Akiyama and Tanigawa [AT90[ proved the Selberg trace formula for modular 
correspondences for cofinite Fuchsian groups and gave explicit evaluations of the trace formula 
for the case of the congruence group Tq(p) (p prime). Hoffmann ([Hof94, Hof88J) approached the 
trace formula for Hecke operator, from the representation-theoretic point of view. 

Strombergsson (|Str98|) gave a very detailed derivation of the Selberg trace formula for modular 
correspondences in the context of weight-zero forms (functions) and trivial unitary representations 
on cofinite Fuchsian groups. He also gave explicit formulas for the case of T = Tq(N) (N is square- 
free). 

In this work, we derive the Selberg trace formula for Hecke operators for cocompact Kleinian 
groups with finite-dimensional unitary representations. In order for the formula to apply, the 
cocompact group T needs to have its commensurator Comm(r) (in PSL(2, C)) strictly larger than 
itself. For each a e Comm(r)\r, we obtain a Hecke operator M. When V is arithmetic, [Comm(r) : 
T] = oo; in fact Comm(r) is a dense subgroup of PSL(2, C) ( IMR03I p. 271, Exer. 8.4.5]). 

1.2. Main results. In this section we state our main results, and briefly describe the notation and 
preliminary material needed to state them (for more details see $2). 

Let T < PSL(2,C) be a cocompact Kleinian group acting on hyperbolic three-space H 3 . Let V 
be a finite-dimensional complex inner product space with inner-product ( , ) v , and let Rep(r, V) 
denote the set of finite-dimensional unitary representations of T in V. Let T C T be a (compact) 
fundamental domain for the action of T in H 3 . 

Let x S Rep(r, V). The Hilbert space of x—automorphic functions is the set of measurable functions 

n(r, x ) = {/ : h 3 -> v | /( 7 p) = xd)f(P) v 7 e r, p e h 3 , 

and (/, /) ee l r (f(P), f(P)) v dv(P) < oo}. 
Finally, let A = A(T, x) be the corresponding positive self-adjoint Laplace-Beltrami operator on 

H(r, x ). 

The commensurator subgroup Comm(r) is the set of all a e PSL(2, C) such that both [r : T n 

a^Ta] < oo and [« _1 ra : T a _1 ra] < oo. 

Throughout this paper we will consider elements a e Comm(r) that satisfy: 

(1) the element a S Comm(r) \ T; 

(2) the unitary representation x G Rep(r, V) has a single-valued extension from T to the set 
TaT, and satisfies the following properties: 

(a) X(ffiaff2) = X(ffi)x(")x(32) for g x ,g 2 E T; 

(b) x( a ) is an invertible linear map on the inner product space V. 

Associated to the element a is the Hecke operator M. : H(r,x) >-> H(r,x) ■ The Hecke operator 
commutes with A . 

Let T> be an indexing set for the set of eigenvalues of A . For each eigenvalue A = A m (m £ T>) , 
let A\ = A(X, T, x) denote the subspace of H(r, x) spanned by {A m | A m = A}. The subspaces A\ 
are invariant under M.. Let A mi . . . A mfc ^ generate A\ (A has multiplicity k\). Since A\ is invari- 
ant under A4, the eigenvalues of M. \ A can be listed as ui mi . . . w mk . Decomposing H(r, x) m to 
invariant subspaces A\, for each m £ T>, we pair X m and uo m . 
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We next state our main result, the Selberg trace formula for Hecke operators. The various notations 
are described very briefly following the theorem; for more details see f|3] 

Our main result is the following: 

Theorem. (Selberg trace formula) Let T be a cocompact Kleinian group. Let a € Comm(r) \ T, and let \ 
be a representation satisfying Assumption \2.1\ Let h be a holomorphic function on {s e C| |Im(s)| < 2+6} 
for some S > 0, satisfying h(l + z 2 ) = 0(1 + |z| 2 ) 3 / 2 ~ £ ) as \z\ — > oo, and let 



S(z) = ^- / h(l + t 2 )e- lt *dt. 



Then 



, n v _ try (xjR-^gjO) log N(T Q ) ^ try (x^' 1 )*) gQogNjT)) 

h> & \s(R)\\MR)r-M + ^ wr?pr logiV(To) 

m^LI i-K}ell {-1 jlox 

Here, {X m }mev are the eigenvalues of A counted with multiplicity, and uj m are the eigenvalues 
of Ai (the Hecke operator associated to a) with the convention of Equation 12.61 The summa- 
tion with respect to {i?} e ii extends over the finitely many T— conjugacy classes of elliptic elements 
R G ra _1 T, and for such a class, N(Tq) is the minimal norm of a hyperbolic or loxodromic element 
of the centralizer C(R) c T; £(R) is the maximal finite subgroup contained in C(R) (see Lemma |3~5l 
for more details). The summation with respect to {T}i ox extends over the T— conjugacy classes 
of hyperbolic or loxodromic elements of ra _1 r, To denotes a primitive hyperbolic or loxodromic 
element of minimal norm ir0 C(T) C T; the element T is conjugate in PSL(2, C) to the transfor- 
mation described by the diagonal matrix with diagonal entries a(T), a(T) _1 with |a(T)| > 1, anc@ 
N(T) = \a{T)\ 2 ; £(T) is the finite cyclic elliptic subgroup of C(T) (see Lemmal331for more details). 
The sum over elliptic elements is finite, and all other sums converge absolutely. 

Please keep in mind that the conjugacy classes {i?} e ii and {T}i ox , the operator A4, and the eigen- 
values uj m all depend on a <G Comm(r) \ T. 

Our first application of the trace formula is to study the distribution of the Hecke eigenvalues. 

Define the elliptic number ofT with respect to a, E a , by the finite sum 

v logiV(To) 
T ~ ^ \£(R)\\(tr(R)y-4\- 

{"jell 

Here the sum is over elliptic conjugacy classes of the set Ta^T, where conjugacy is defined with 
respect to the group T. The notations above are defined in £13.51 

We have 

Theorem. Let Tbea cocompact Kleinian group with a e CommiT) \ T. Then 

V uj m e~ Xmt = + 0{Vt) ast->Q + . 

rn£T> v 



''Note that there is no clear relationship between T 6 ra _1 r and To 6 T. 

^Please note that there is a typographical error in the loxodromic and non cuspidal elliptic terms in IEGM98I Theorem 
6.5.1; both terms are missing a factor of j-. 
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Here E" is the elliptic number ofT with respect to a, {X m } m ev are the eigenvalues of A counted with 
multiplicity, and uj m are the eigenvalues of M. (the Hecke operator associated to a) with the convention of 
Equation \2.6\ 

If the set ra _1 r contains no elliptic elements we have 

Theorem. Let T be a cocompact Kleinian group with a £ Comm(T) \ T. Suppose that the set Ta~ 1 r 
contains no elliptic elements. Then 

u m e~ Xmt = O (V 1/2 exp(-c/i)) as t -> 0+. 

mev 

Hence 

lim V uj m e~ Xmt = 0. 

m£T> 

Here {X m }mev ore the eigenvalues of A counted with multiplicity, and cu m are the eigenvalues of M (the 
Hecke operator associated to a) with the convention of Equation \2.6\ 

Finally, we give an analogue of Huber 's theorem. 

Following |EGM98|, we define the length spectrum of ra _1 r. For loxodromic Tj e Ta _1 r set 
fij = log N(Tj). The length spectrum of Ta^T is defined to be 



r = 



( \ 

v iogiv(r ) 

J- \£(T)\\a(T)-a(T)-^ 
\ i 1 rim I 

\ log N(T)= H / 



3>1. 



In the two-dimensional case the length spectrum simply comprises the lengths of closed geodesies. 
Here we really need the complex lengths a(T) and the order of the elliptic, finite subgroup of C(T), 
\£(T)\. 

We define the eigenvalue spectra of A and M. (M. is defined from a 6 Comm(r) \ V) by 

5p = (A J , W (A J )) JeI ,.. 

Here the symbol D* means that we do not count with multiplicity, and co(X) is the trace of M on 
the invariant subspace generated by all eigenfunctions (of A) with eigenvalue A. 

Theorem. Let T, r' be cocompact Kleinian groups with a E Comm(T) \ T, oi E Comm{T') \ V . Then 
the following hold: 

(1) Suppose that and S^, agree up to at most finitely many terms. Then 

rpa rpa' 

il/p — il/p/ 

pa pa 

Op — Op/ 

pOL nOL 

A-/p/ . 

(2) Suppose that £p and £p, agree up to at most finitely many terms. Then 

i^p — i^p/ 

PQ Pft 

Op — Op/ 
r*a pa 
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By applying the above Theorem to the case of a single fixed group with two different elements 
a, a' € Comm(r) \ T, we obtain: 

Corollary. Let The a cocompact Kleinian groups with a, a' e Comm(T) \ T. Let uj{\ m ) — uj'(X m )for all 
but at most finitely many m gT>*. Then w(A TO ) = uj'(\ m )for all m g V*. 

2. Preliminaries 

In this section we review the basic notions needed to evaluate the Selberg trace formula for mod- 
ular correspondences. See ]Hej76 Chapter 5] for the analogous Fuchsian cas^. 



2.1. Cocompact Kleinian groups. Let T < PSL(2,C) be a cocompact Kleinian group acting on 
hyperbolic three-space H 3 . Let V be a finite-dimensional complex inner product space with inner- 
product ( , ) v , and let Rep(r, V) denote the set of finite-dimensional unitary representations of T 
in V. Let C T be a (compact) fundamental domain for the action of T in H 3 . 

Let x G Rep(r, V) . The Hilbert space of x—automorphic functions is the set of measurable functions 

H(r, x) = {/ : h 3 -» v | fop) = xd)f(P) v 7 e r, p e h 3 , 

and (/, /) = ^ (/(P), /(P)) y < ex.}. 

Finally let Z\ = A(T, x) be the corresponding positive self -adjoint Laplace-Beltrami operator on 

H{r, x ). 

2.2. Hecke operators. In this section we define the Hecke operators (or modular correspondences). 
For more details see | Hej76 Chap. 5] for the cocompact Fuchsian case, |Str98] for the cofinite Fuch- 



sian case. 

Let r be a cocompact Kleinian group. The commensurator subgroup Comm(r) is the set of all 
a e PSL(2, C) such that both [r : T n a^Ta] < oo and [a~ l Ya : V n a^Ta] < oo. 

Let x S Rep(r, V). By definition, Comm(r) c T. However, in order to define non-trivial Hecke 
operators, we will need to start with an element a € Comm(r) that lies outside of T. We will also 
need the unitary representation x to extend from T to the set TaT. More precisely: 

Assumption 2.1. Throughout this paper we assume: 

(1) The element a € Comm(T) \ T; 

(2) T/ie unitary representation x & Rep(r, V) has a single-valued extension from T to the set TaT, 
and satisfies the following properties: 

(a) x{giug2) = x{9i)x(ot)x(92) for gi,g 2 G T; 

(b) x( a ) zs an invertible linear map on the inner product space V. 



See |Hej76 Pages 463-4] for the analogous Fuchsian case. 



Let d = [r : T n a^Ta]. It follows, by conjugation, that [a^Ta : T n a^Ta] = d. 



7 There is much overlap between the Fuchsian case and our case, the Kleinian case. We will often cite the Fuchsian case, 
as a reference when proofs in the two cases are identical. 



MODULAR CORRESPONDENCES 



6 



Let the symbol |J denote disjoint union. Then 

d d 

T = \_\ (Tn a^Ta) €i iff Far = |J Tae,. 

i=i i=i 

Setting on = ati (i — 1 . . . d), we define the operator M. : H(r, x) W(P, x) by 

d 

(Mf)(P) = Y / x(a i Tf(a i P). 

z=l 

The operator M. does not depend on the above choice of coset representatives, and it is a bounded 
linear operator on H(r, x ) ([Hej76, p. 467] or |Str98l ). 

The adjoint of M can be constructed as follows: Since a £ Comm(r), and Comm(r) is a group; 
a -1 also satisfies Assumption 12.11 As before, we can write 

e 

ra- x r= \Jrpi. 

i=l 

It follows that e = d ( |Hej76| p. 469]). Define M* : H{r, x ) ^ H{r, x ) by 

(M*f)(z) = J2x(f3 l : 1 )f(foP)- 

2 = 1 

For every /, g e H(P, x) we have ( ]Hej76] p. 470]) 

(Mf,g) = (f,M*g). 

2.3. Interplay between A and M. For P = z + rj, P' = z' + r'j G H 3 set 
,2.1) StP,P>) ^-^+f + <" . 

It follows that S(P, P') = cosh(d(P, P')), where d denotes the hyperbolic distance in H 3 . Next, for 
k e <S([1, oo)) a Schwartz-class function, define the point-pair invariant K(P, Q) = k(S(P, Q)). Note 
that for all 7 e PSL(2, C) we have K (7P, 7Q) = X (P, Q). Define the Poincare series 

K r (PQ) = Y,x(T)K(P,TQ). 
Ter 

The series above converges absolutely and uniformly on compact subsets of H 3 x H 3 , and is the 
kernel of a bounded operator K. : H(r, x) l— * W(-T, x) • The Selberg theory allows us to diagonalize 
K. with respect to a basis of eigenfunctions of A . 

We first need the following spectral expansion: Each / 6 H(r, x) has an expansion of the form 
(2-2) /(P)= </»em)e m (P). 

m£X> 

Here the sum converges in the Hilbert space 7i(P, x) 1 an d T> is an indexing set of the eigenfunctions 
e m of A with corresponding eigenvalues A m . 

Now, let /i be the Selberg-Harish-Chandra transform of fc; explicitly, for A=l-s 2 eC, 
(2.3) h(\) = h(l-s 2 ) = - r k(\ (t + \\) (i s - t-°) (t- 1 ' ' /; 



,s 



2 \ t J J y ' V t J t ' 
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and let g be the Fourier transform of h : 

(2.4) 9{x) = ^- I h(l + t 2 )e- itx dt. 

For v, w <E V let v (g> w be a linear operator in V defined by v ® =< a;, to > u. An immediate 
application of the spectral expansion (|2.2b and the Selberg-Harish-Chandra transform (|2.3l l gives 
us (see HFri05allFri05bl or HEGM981 Equation 6.4.10, page 278]): 

Lemma 2.2. Le£ k £ S and h : C — > C foe f/ze Selberg-Harish-Chandra Transform of k. Then with 
defined above, we have 

(2.5) ^ r (P, Q)=J2 K^n)e m {P) ® i^(Q) 

raEE 

Tfoe sum converges absolutely and uniformly on compact subsets ofM 3 x H 3 . 



Since the Laplace operator A commutes with the action of PSL(2,C) on H 3 , it follows that A 
commutes with A4. From Selberg's original ideas (|Sel56|), the operator K, = h(A), and thus M. 
must also commute with JC. A direct proof of this fact is given in |Hej76, p. 473]: 

Lemma 2.3. Let K. be the linear operator defined from the kernel function Kr(P, Q). Then, on H(r, x) 

JCM = MIC, 

and onH(r,x)r)C 2 (U 3 ) 

M A = AM. 



For each eigenvalue A = A TO (me V), let A\ = A(X, T, x) denote the subspace of H(r, x) spanned 
by { A m | A m = A} . Since A commutes with M , it follows that the subspaces A\ are invariant under 
M. Let mi . . . mk x € T> generate A\ (A has multiplicity k\). Since A\ is invariant under M, the 
eigenvalues of M \ Ax can be listed as u mi ■ ■ ■ u mhx ■ Next, we define 

kx 

(2.6) u{X)=ixM\ Ax =Y, u m r 

i=i 

Decomposing H(r, x) into invariant subspaces A\, for each m £ V we pair A m and oj m . Since M 
is a bounded operator, we conclude that the u> m (m G T>) are uniformly bounded. 



3. The Selberg trace formula for Hecke operators 



The standard Selberg trace formula is an explicit evaluation of both the integral and spectral of the 
operator JC . In our case of interest we evaluate the trace of JCM . 
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3.1. The kernel of operator KM. The first step is to construct a Poincare series for the kernel of 
KM. 

For all / g H(r, x), by Lemma [231 and by definition, 

KMf(P) = MKf(P) = J^M P K T {P,Q)f{Q)dv{Q). 

Here M pKr(P, Q) is the action oi M, treating Kr(P, Q) as a function of P. Set 
(3-1) K M {P,Q)= Y, x(T~ l )*K(P,TQ), 

iflthen follows fl |Hej76{ p. 476]) that K M (P, Q) = M P K r {P, Q). Hence: 
Lemma 3.1. For all f e H{r, x), 

KMf(P) = MKf(P) = J^K M (P,Q)f(Q)dv(Q). 
Upon applying M to J2.5I I, we obtain 

(3.2) K M {P, Q)=J2 /l ( A ™) {Me m {P))®^{Q). 

mET> 

The Selberg trace formula will result from a careful evaluation of 

tr(KM) = J try K M (P, P) dv(P). 

3.2. Spectral trace. Since Km (P, Q) is a continuous function on the compact set T x T, the integral 

J tr v K M (P,P)dv(P) 

converges absolutely. Since M is bounded, the derivation of the standard Selberg trace formula 
for cofinite Kleinian groups [EGM98 §6.5] implies that 

(3.3) { try K M (P, P) dv{P) = ^ h{X m )w m . 

mev 

3.3. Integral trace. Selberg's clever method of evaluating the integral (|3.3b entails decomposing 
the Poincare series Km (P, Q) into conjugacy classes of various types of isometries (the types being: 
elliptic, parabolic, hyperbolic, . . . ). A similar method works here, though conjugacy classes must 
be defined in the context of the set Ta~ 1 T. One also must deal with centralizer subgroups of 
various isometries, which lead to complications not found in the standard Selberg trace formula 
derivations. 

ForTe To^rset 

{T} = {T} r = {a^Ta \ a G T}, 

and set 

C(T) = C r (T) = {aeT\aT = Ta}. 



®Note that \ is not necessarily unitary when extended to TaY, sox{T 1 )* can not be simplified. 
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It now follows (|Hej76 pp. 480-482]) that 

(3.4) tr[KM) = Vtiv^T- 1 )*) f K(P,TP) dv(P). 

Here the sum is over all conjugacy classes of ra _1 r with respect to T; F(C(T)) is a fundamental 
domain for the subgroup C(T). 

Since the integral in i3A\ is invariant when T is conjugated within PSL(2, C), it suffices to choose 
a conjugate of T which has the simplest form to allow one to explicitly evaluate the following 
integral: For T e Ta^T set 

(3.5) I(T) = I r (T) = f K(P,TP)dv(P). 

Jr(c(T)) 



There are four cases to consider: 



T 



(1) T — id (this case does not occur by Assumption l2.1b 

(2) T is loxodromic 

(3) T is elliptic 

(4) T is parabolic. 

In fact, we must first compute the structure of each centralizer subgroup C(T). 

See IEGM981 chap. 1] for details on the action of PSL(2, C) on H 3 , and for the definitions of loxo- 
dromic, parabolic, . . . 

3.4. Loxodromic case. Suppose that T e ra _1 r is loxodromic. We can then assume (replacing T 
by its unique conjugate within PSL(2, C)) that T has the form 

a(T) 
a(T)- 1 

such that a(T) g C has |o(T)| > 1. Let N(T) denote the norm of T, defined by 

N(T)^\a(T)\ 2 . 

For z + r j e H 3 

(3.6) T(z + rj) = a{T) 2 z + N(T)rj. 

The element T fixes two points: and joo 6 C. It follows from elementary calculations that any 
u G C(T) c r must be of the form 

' u 
u- 1 

Since V is discrete and cocompact, it follows (|EGM98, chap. 5]) that C(T) has at least one element 
of minimal norm. Choose one, say To . The other minimal norm elements are obtained by multi- 
plying by the elliptic elements of the finite cyclic elliptic subgroup £(T) of order m(T), generated 
by an element Et ■ We now have 

C(T) = (T ) x £(T) . 

Here (To) = { T n \ n e Z }. The elliptic element Et is conjugate in PSL(2, C) to an element of the 
form 

' C(T ) 

o any 1 
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where here C(^o) is a primitive 2m(T)-th root of unity. 

Note that (by definition) if T £ T, T ^ C(T). It seems conceivable then that C(T) could be a finite 
group. However, in the next lemma we will show that AT (To) > 1 which implies that C(T) contains 
an infinite cyclic loxodromic subgroup^. 

Lemma 3.2. Let T e Ta~ 1 T. Then C(T) contains a loxodromic element T of minimal norm AT (To) > 1. 

Proof. Let k G <S[1, oo) be a smooth, positive bump function with k = 1 on [1, 2], (zero everywhere 
else) and let x be the trivial representation. The right-hand side of l|3.3t converges absolutely, and 
by positivity the left side does, too. Hence l|3.4t and d3-5|> imply that 

(3.7) / K(P, TP) dv(P) < oo. 

For ip e M. set 

/ \ 

, e"* J • 

P(</?) is a rotation on H 3 that fixes 0, ooj 6 C. For z + r j S H 3 , 

R(tp){z + rj) — e ltp z + rj. 

Next, suppose there are not loxodromic elements in C(T), that is, that C(T) = (R(<p)), where 
ip = |£, and m = |P(^)| = |C(T)|. A fundamental domain for C(T) is given by (see IEGM98I p. 
193]) ™ 

f 27T 

J"i = <^ pe^ + rj I r > 0, p > 0, < cp < — 

m 



R(<p) 



We claim that 
(3.8) 

I Fx 

To see this, first note that using 03.61 1 and | |2.1> , we can simplify K (P, TP). We obtain 

|a(f) 2 - l| 2 |z| 2 + {N(Tf + l) 2 r 2 \ dxdydr 



/ K(P,TP)dv{P) = oo. 



/ AT(P, TP) dv{P) = I k 

JFx JTx 



2N(T)r 



2 



Applying the elementary substitution x i— ► rx, y i— > ry; the integral becomes 

>(<) 2 - l| 2 |z| 2 + (A^(T) 2 + 1) 2 \ ctecfydr 



& 



2N(T) 



r A(^) V 2N(T) 1 



Here z(.Pi) is the standard projection of JFi c H 3 onto C. Hence C(T) must contain at least one 
loxodromic element, and since T is discrete, C(T) must contain a minimally normed element. □ 



9 This is closely analogous to the Fuchsian group case, where the centralizer of a hyperbolic element is infinite [Hej76] p. 
483]. Another analogous result: "... In dimension 3, the centralizer of an elliptic element of a group with compact quotient 
never is a finite cyclic group. " ]EGM98, p. 194], Meanwhile in dimension two, it is a finite cyclic group. 
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An element R in T is called primitive if there does not exist S € T with 5 m = i? for some positive 
integer m. Since the To from Lemma |3~51 has minimal norm in C(T), it is necessarily primitive. 

Now that we see that the structure of C(T) is identical to the case where TeT ( IEGM981 p. 193]), 
hence we can evaluate the integral (13.5b , obtaining: 

Lemma 3.3. Let T e Comm(r) be loxodromic (hyperbolic elements are considered loxodromic). Let 

C(T) = (To) x £(T) 

with T loxodromi^and primitive, and £(T) a finite cyclic subgroup of elliptic elements. Then 

g(logN(T))logN(T ) 



[ K(P, TP) dv{P) 



h ( c(T)) V ' ' " ' \£(T)\\a(T)-a(T)-^- 
Here, g comes from | |2.4|| and l|2.3b . 

3.5. Elliptic case. Suppose that R e Ta~ 1 r is elliptic. We can then assume (replacing R by its 
unique conjugate within PSL(2, C)) that R has the form 

i? = %)=( f J (pel). 

ii(</?) is a rotation on H 3 that fixes 0, ooj 6 C. For z + r j 6 H 3 , 

R((p)(z + rj) = e lv z + rj. 
An elementary calculation shows that 

c rf)^SL(2,C) 
commutes with i?(</?) iff one of the two conditions are satisfied: 

(1) b = c = Q 

(2) exp ^ = ±i and a = d = 0. 

In both cases, a similar argument to Lemma [3721 (see IEGM98, pp. 193-194]) shows that C(R) 
contains loxodromic elements. In particular C(R) contains a loxodromic element of minimal norm 
T . Following IIEGM981 pp. 193-197] and generalizing to R e Comm(r) we have ( IEGM981 Thm. 
5.2.110 

Lemma 3.4. Let R e Comm(r) be elliptic. Then there exists a primitive elliptic element R e C(R) c T 
(it is possible that R = id), an element T e C(R) loxodromic, of minimal norm in C(R) so that one of the 
following cases holds: 

(1) Either all the elliptic elements ofC(R) are contained in £(R) = (Rq) , and 

C(R) = (T ) x £(R). 



^Note that there is no clear relationship between T and To other than the fact that they have the same fixed points and 
commute. It seems reasonable to conjecture that T = n for k, n £ N. 
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We modified their hypothesis to allow J? to be in Comm(r) instead of in V. We are justified by the proof of Lemma |3^2l 
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(2) Or R is elliptic of order 2, and there exists an elliptic element S e C(R) so that 

£(R) = (Ro) U (Ro) S 

and 

C(R) = (T ) x £{R). 
See IEGM981 pp. 191-198] for more details. 

Now that we see that the structure of C(T) is identical to the case where T e T ( IEGM981 p. 193]), 
we can evaluate the integral 03 .5b , obtaining: 

Lemma 3.5. Let R e Comm(r) be elliptic. Let 

C(R) = (T Q ) x £{R) 

as in Lemma \3A\ Then 

5 (0)logiV(To) 



/ K(P,RP)dv(P) = 



— — \£{R)\\{tv[R)f-A\- 
Here, g comes from i2.4b and (|2.3t . 

We will also need the following: 

Lemma 3.6. Let R G Comm(r) be elliptic. Then there are only finitely many elliptic conjugacy classes of 
Ta~ 1 T, where conjugacy is defined with respect to V. 

Proof. Let k e S[l, oo) be non-negative and let \ be the trivial representation. By l|3.4|l and d3.3b , 

V / K(P,RP)dv(P) < oo. 

rr ,, J nam 



{R} 



Hence by Lemma [331 



m & \£{R)\\(tv(R)y - ±\ <oc - 



Now, since N(T ) > 5 > 1 (independent of T ) and since —2 < tr(_R) < 2, in order for there to be 
infinitely many conjugacy classes, it is necessary for \£ (R)\ to be unbounded as R goes through 
all conjugacy classes. But by Lemma [3.41 that would imply the order of each Rq is unbounded; a 
contradiction since cofinite Kleinian groups have only finitely many conjugacy classes of elliptic 
elements (and two elements in the same conjugacy class have the same order; see|EGM98J). □ 

3.6. Parabolic case. Suppose that T e Comm(r) is parabolic. We will soon see that this case can 
not occur when T is assumed to be cocompact. That is: Comm(r) contains no parabolic elements 
when r is cocompact. To see this, suppose that T is already conjugated into the simple form 



T 



Then, an elementary calculation shows that 

a b 

c 



1 T 

1 



S= ( : " d ) ePSL(2,C) 
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commutes with T iff c = and a = d = ±1. By definition, S must be parabolic (or the identity). 
But, since T is cocompact, it contains no parabolic elements. So C(T) = id. An argument similar to 
Lemma l3T2l shows that this can not happen. Hence there are no parabolic elements in Comm(T)\r. 

3.7. The Selberg trace formula. By putting together l|3.4|l , Lemma l3~3l Lemma l331 Assumption ^. 11 
and the results of £ 13.61 and by applying standard approximation techniques in order to allow more 



general growth conditions on the function k (and hence on h and g) (see ] Hej76 pp. 32-34] for the 
details), we obtain: 

Theorem 3.7. (Selberg trace formula) Let F be a cocompact Kleinian group. Let a e Comm(r) \ r, and 
let xbea representation satisfying Assumption \2.1\ Let hbea holomorphic function on {s e C 1 1 Lm(s)| < 
2 + 6} for some S > 0, satisfying h(l + z 2 ) = 0(1 + |z| 2 ) 3 / 2 ~ c ) as \z\ — > oo, and let 



g{x) = ±. f h(l + t 2 )e~ itx dt. 



Then 



, \- trvixiR-^g^logNjTo) ] ^ try^T' 1 )*) g (log N(T)) 

mizU irt}ell i-L llox 

Here, {X m }mev are the eigenvalues of A counted with multiplicity, and cj m are the eigenvalues 
of A4 (the Hecke operator associated to a) with the convention of Equation 12.61 The summa- 
tion with respect to {i?} e ii extends over the finitely many T— conjugacy classes of elliptic elements 
R e ra _1 r, and for such a class, AT (To) is the minimal norm of a hyperbolic or loxodromic element 
of the centralizer C(R) c T; £(R) is the maximal finite subgroup contained in C(R) (see Lemma l3~5l 
for more details). The summation with respect to {T}i ox extends over the T— conjugacy classes 
of hyperbolic or loxodromic elements of ra _1 r, To denotes a primitive hyperbolic or loxodromic 
element of minimal norm 

ir{3 C(T) C T; the element T is conjugate in PSL(2, C) to the transfor- 
mation described by the diagonal matrix with diagonal entries a(T), a(T) _1 with \a(T) \ > 1, ancj3 
N(T) = \a(T)\ 2 ; £(T) is the finite cyclic elliptic subgroup of C(T) (see Lemma l3~3l for more details). 
The sum over elliptic elements is finite, and all other sums converge absolutely. 

Please keep in mind that the conjugacy classes {i?} e ii and {T}i ox , the operator M, and the eigen- 
values uj m all depend on a <G Comm(r) \ V. 

3.8. Self-Adjoint Hecke Operators. Throughout this work we were under Assumption 12.11 By 
imposing stronger conditions on a and \ we can ensure that M. is self-adjoint. 

Assumption 3.8. In addition to Assumption \2.1\ 

(1) TaT = ra _1 r 

(2) x(a- 1 )=x(«)*- 

Assumption l3.8l implies that M is self-adjoint. Since M. commutes with A we can choose a simul- 
taneous diagonalization {e m } m£ n so that 

Ae m = \ m e m and Me m = cu m e m . 



12 Note that there is no clear relationship between T £ Ya 1 V and To £ T. 

13 Please note that there is a typographical error in the loxodromic and non cuspidal elliptic terms in IEGM981 Theorem 
6.5.1; both terms are missing a factor of j- . 
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4. Application of the Trace Formula to the distribution w m . 

In the Selberg trace formula (Theorem 13. 7\ , the eigenvalues A m of A do not depend on M.. The 
distribution of these eigenvalues has been well studied IHub59[ ISel56l |Hej76[ IEGM981 rVen82l . 
More specifically, in the case of cocompact Kleinian groups we have 

Theorem 4.1. IEGM98, p. 308] Let T be a cocompact Kleinian group. Then 

voi(r) 

8tt 3 / 2 



Stt3/2 



Here vol(r) is tte volume of a fundamental domain for the action ofT in H 3 . 

For T a cocompact Kleinian group with a € Comm(r) \ T, define -E Q the elliptic number ofT with 
respect to a by 



(4.1) Er=Y, 



logiV(To) 



,f(J2)||(tr(i2)) 2 -4| 



(see £]3.5l for the definitions of the above notation). 
Our result is as follows: 

Theorem 4.2. Let T be a cocompact Kleinian group with a e Comm(T) \ T. Then 

V cj m e~ Am * = -yL= + 0(Vt) ast->0+. 

Here E" is the elliptic number ofT with respect to a, {A m } me x> are the eigenvalues of A counted with 
multiplicity, and uj m are the eigenvalues of M (the Hecke operator associated to a) with the convention of 
Equation \2.6\ 

Proof. It follows from Lemma l4~3l (below) that the loxodromic sum in l|4.2ll is bounded by O (t -1 / 2 exp( 
as t — > + . Hence 



oj m e tx " 



E 

^ £ sSfi + ('- 1 ' 2 — /f ») + — + 

□ 

Lemma 4.3. Lei T be a cocompact Kleinian group with a € Comm(T) \ V. Then there exists a constant 
cq > 1 so i/zaf AT(T) > cq for all conjugacy class {T} 6 {T}; ox . 

Proof. Recall that {T}i ox is the set of conjugacy classes of loxodromic elements of ra _1 T, where 
conjugacy is taken with respect to the group V. An application of the Selberg trace formula, for the 
pair of functions 

, . . . . . . exp(— t) ( r 2 

h(z) = exp(-zt), g(r) = ±— exp I - — 
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yields 

(4.2) X ' X 



u! m e 



( (log N(T)f\ 

exp(-t) v logjV(To) exp(-t) v exp l~ « ) 

V^i \£{R)\\(tr{R)) 2 -^\ V^t \£(T)\\a(T)-a(T)-^ g [ 0) ' 

t-K}ell {J ilox 

For t > the left hand side of j4.2l l converges absolutely. Fix t = 1. Now, the sum over loxodromic 
terms is comprised of positive terms. Hence each term of the form 



exp 



^ (logJV(T)) 2 ^ 



logiV(To) 



\S(T)\\a(T)-a(T)-i\ 

must be bounded by a constant independent ofT and T . Since T is a discrete group, there exists a 
constant do > 1 so that N(Tq) > do for all loxodromic To € T. Hence log N(Tq) is bounded above 
zero, uniformly (since T e T). It thus follows that \a(T) — a(T) -1 | must be uniformly bounded 
above zero. In other words, there is a constant c > 1, independent of T, with |a(T)| > cq. Noting 
that N(T) = |a(T)| 2 , the Lemma follows. □ 

Theorem 14 .21 immediately implies: 

Theorem 4.4. Let T be a cocompact Kleinian group with a e Comm(T) \ T. Suppose that the set Ta -1 r 
contains no elliptic elements. Then 

^2 Urne~ Xmt = O (V 1/2 exp(-c/i)) as t -> 0+. 
men 

Hence 

lim V Lj rn e~ Xmt = 0. 

m£X> 

Here {X m }meT> we the eigenvalues of A counted with multiplicity, and uj m are the eigenvalues of M. (the 
Hecke operator associated to a) with the convention of Equation \2.6\ 

5. Analogues of Huber's Theorem for Hecke Operators 

Following [EGM98. p. 202], we define the length spectrum of ra _1 r. For loxodromic Tj e Ta~ 1 r 
set fij = log N(Tj). The length spectrum of ra _1 r is defined to be (see S]3]for the notation) 



( \ 

v iogiv(r ) 

ft \E(T)\\a(T)-a(T)-i\* 

\ log N(T)= H ) 



3>l- 



In the two-dimensional case the length spectrum is simply comprises the lengths of closed geodesies. 
Here we really need the complex lengths a(T) and the order of the elliptic, finite subgroup of C(T), 
\£{T)\. 

We define the eigenvalue spectra of A and M. (M. is defined from a € Comm(r) \ V) by 
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here the symbol D* means that we do not count with multiplicity: recall that ui(X) is the trace of A4 
on the invariant subspace generated by all eigenfunctions (of A) with eigenvalue A, so multiplicity 
is already encoded into w(A). 

Theorem 5.1. Let T, V be cocompact Kleinian groups with a e Comm(T) \ T, a' e CommiY') \ V . 
Then the following hold: 

(1) Suppose that Sf* and S^, agree up to at most finitely many terms. Then 

r?a r?a' 

£/p — -C/p/ 

5 a nfl 
p — Op/ 

pa pa 

jUp — A_<p/ . 

(2) Suppose that £p and £p,' agree up to at most finitely many terms. Then 

rpcy rpa' 

_C/p — _C/p/ 

PQ PQ 

Op - — - Op/ 

r*a r*a 

>Up — Z^p/ . 

Proof. Upon applying the Selberg trace formula (with trivial representations) to the pair of func- 
tions, 

h ( w ) = ~1~7~ T ~ p2 ■ 1 7 

s* + w — 1 _d + u; — 1 

where 1 < Re(s) < Rc(B), we obtain 

(5.1) 1 V logA ™ N(T)- - JL V ^™ mt)-« 

1 ; 2s fa m(T)\a(T)-a(T)-^ [> 2B fa m(T)\a(T) - a(T)~^ [) 

i-l jlox i-l Jlox 

= V (}. ) ( 1 1 \ ( 1 1 \ V logiV(To) 

" j U 2 -4 S 2 -47 U \£{R)\ |(tr(fl)) 2 -4|' 

Here = 1 — A„ and s n is chosen to lie in {z S C | Im z > 0, Re z > }. The Theorem follows 
by comparing asymptotics. Simply apply the proof of the [EGM98, Theorem 3.3, p. 203] replacing 
[EGM98. Equation 5.2.35, p. 198] with our <5.H . Note that our symbol w(X n ) is the analogue of the 
multiplicity of A n as considered in [EGM98J. □ 

By applying the above Theorem to the case of a single fixed group with two different elements 
a, a' G Comm(r) \ T, we obtain: 

Corollary 5.2. Let T be a cocompact Kleinian groups with a, a' e Comm(T) \ T. Let uj{\ m ) = w'{\ m ) 
for all but at most finitely many m e V*. Then w(A m ) = uj'{\ m )for all m e V*. 
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